Automatic event classification

ABSTRACT

A system and methods for classification of events, the system including a memory, a network interface, and a processor configured to monitor system events via the network interface and store the system events as an event log in the memory, collect information about events from various web resources, extract, from the event log and the collected event information, labeling data including data about urgency of events and generate, based on the extracted labeling data, labeling data structures ascribing labels to respective events, extract, from the event log and the collected event information, event features data and generate, based on the extracted event features data, event features data structures ascribing features to respective events, and formulate decision rule structures for identification of urgent events based on the labeling data structures and the event features data structures.

RELATED APPLICATION

This application claims the benefit of priority under 35 USC § 119(e) ofU.S. Provisional Patent Application No. 62/364,349 filed Jul. 20, 2016,the contents of which are incorporated herein by reference in theirentirety.

FIELD AND BACKGROUND OF THE INVENTION

Many Information Technology (IT) infrastructures utilize services forprocessing and storage of data. Such services include, for example, adata center, a private cloud, a VMware or Open stack environment, Mobileenvironment, IoT devices, Amazon Web Services, Microsoft Azure, publiccloud security tools, log analytics platforms and other cloud services.

These services may have limited availability, stability, scalability orsecurity due to multiple reasons, including, but not limited to,frequent variations in loads, software changes, configuration changes,hardware failure, human error, cyber attack and malicious users. Forexample, constant variations in the tasks and in the number of activeusers may cause great fluctuations in the processing performance.Therefore, IT administrators may face frequent failures and reliabilityissues.

Some known platforms enable IT administrators to monitor data, eventsand/or logs, in order to collect information about various issues, forexample by processing data gathered from, for example, operating systemlogs, proxy server logs, server logs, application logs and loadbalancing logs.

SUMMARY OF THE INVENTION

A subject of some embodiments of the present invention is to provideranked data from various sources about a certain system situation.Current platforms provide huge amounts of data and users may havedifficulties in deducing conclusions from the data. By gathering andisolating issue-specific data, some embodiments of the present inventionprovide easy-to-understand visualization of information about thespecific situation and possible solutions.

An aspect of some embodiments of the present invention provides a systemfor classification of events, the system including a memory, a networkinterface and a processor configured to execute a code for: monitoringsystem events via the network interface and storing the system events asan event log in the memory, collecting information about events fromvarious web resources, extracting, from the event log and the collectedevent information, labeling data including data about urgency of eventsand generating, based on the extracted labeling data, labeling datastructures ascribing labels to respective events, extracting, from theevent log and the collected event information, event features data andgenerating, based on the extracted event features data, event featuresdata structures ascribing features to respective events, and formulatingdecision rule structures for identification of urgent events based onthe labeling data structures and the event features data structures.

According to some embodiments of the present invention, the data abouturgency of events includes at least one of data about stability, dataabout criticality, data about failure imminent, data about adenial-of-service attack, data about threats detected, data aboutanomalies detected, data about business impact, and data aboutrelevance.

According to some embodiments of the present invention, the collectedevent information includes labeling data and event features receiveddirectly from a user via a feedback interface.

According to some embodiments of the present invention, the processor isconfigured to execute code for using a signature-less self-learningsystem for formulating the decision rule structures.

According to some embodiments of the present invention, the processor isconfigured to execute code for classification of log events according tolocations of log events in the data structures.

According to some embodiments of the present invention, the processor isconfigured to execute code for combining the collected event informationwith data received directly from a user to formulate the decision rulestructures.

According to some embodiments of the present invention, the processor isconfigured to execute code for formulating a solution list about a givenevent, including information about the event, according to the decisionrules. The system may further include a solution database configured tostore the formulated solution lists in association with the respectiveevents, wherein the processor is further configured to execute code forreceiving user queries about system events and providing the associatedsolution lists in response to the user queries.

According to some embodiments of the present invention, the systemincludes a user interface configured to receive user feedback aboutevents, wherein the processor is further configured to execute code forextracting labeling data and/or event features data from the userfeedback. The processor may be configured to execute code for building auser profile based on queries and/or labels received via the userinterface. The processor may be configured to execute code for utilizingthe user profile to enhance the labeling data extraction. The processoris configured to execute code for utilizing the user profile to generatea personal event scoring per user.

According to some embodiments of the present invention, the processor isfurther configured to detect patterns in the labeling and/or eventfeatures data structures and to formulate the decision rules based onthe detected patterns.

According to some embodiments of the present invention, the systemfurther includes a query interface to receive user queries about events,wherein the processor is further configured to execute code forextracting labeling data and/or event features data from the userqueries. The processor may be further configured to execute code formonitoring user behavior at the query interface and to extract labelingdata and/or event features data from the user queries. The processor maybe further configured to execute code for monitoring the user behaviorwith a user service engine, to analyze the user behavior and to furtherformulate the decision rule structures based on the user behavior.

According to some embodiments of the present invention, the processor isfurther configured to execute code for mapping a user query into thelabeling data structures and event features data structures, identifyingbased on the mapping query-related log events, and relating to the userquery at least one associated decision rule.

According to some embodiments of the present invention, the processor isfurther configured to execute a translator to translate the eventsinformation to computable machine data.

According to some embodiments of the present invention, the processor isfurther configured to execute code for generating the labeling datastructures in the form of data vectors, in which labeling data is storedin association with respective events. The labeling data may be storedin association with respective events and classification tasks.

According to some embodiments of the present invention, the processor isfurther configured to execute code for generating the labeling datastructures in the form of clusters of events, wherein each cluster has acorresponding label. In some embodiments, at least one of the eventsbelongs to more than one cluster. In some embodiments, at least one ofthe clusters is associated with a classification task.

According to some embodiments of the present invention, the processor isfurther configured to execute code for storing the system events in theevent log along with a respective time stamp.

According to some embodiments of the present invention, the processor isconfigured to execute code for classifying the collected informationaccording to respective events and/or classification tasks.

According to some embodiments of the present invention, the processor isconfigured to execute code for extracting the labeling data based onmultiple monitored events.

Another aspect of some embodiments of the present invention provides amethod for classification of events, the method including monitoring, bya processor, system events via the network interface and storing thesystem events as an event log in the memory, collecting, by theprocessor, event-related information about events from various webresources, extracting, by the processor, labeling data, including dataabout urgency of events, and event features data, from the event log andfrom the event-related information, generating, based on the extractedlabeling data, labeling data structures ascribing labels to respectiveevents, and based on the extracted event features data, event featuresdata structures ascribing features to respective events, and formulatingdecision rule structures for identification of urgent events based onthe labeling data structures and the event features data structures.

Another aspect of some embodiments of the present invention provides amethod for classification of events, the method including receiving auser query about a system event via a user interface, monitoring, by aprocessor, user behavior in relation to the user interface, formulatingdecision rule structures for formulation of solution lists about eventsbased on the user behavior, and instructing formulation and transmissionto the user of a solution list relevant to the user query, based on thedecision rules.

Unless otherwise defined, all technical and/or scientific terms usedherein have the same meaning as commonly understood by one of ordinaryskill in the art to which the invention pertains. Although methods andmaterials similar or equivalent to those described herein can be used inthe practice or testing of embodiments of the invention, exemplarymethods and/or materials are described below. In case of conflict, thepatent specification, including definitions, will control. In addition,the materials, methods, and examples are illustrative only and are notintended to be necessarily limiting.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Some embodiments of the invention are herein described, by way ofexample only, with reference to the accompanying drawings. With specificreference now to the drawings in detail, it is stressed that theparticulars shown are by way of example and for purposes of illustrativediscussion of embodiments of the invention. In this regard, thedescription taken with the drawings makes apparent to those skilled inthe art how embodiments of the invention may be practiced.

In the drawings:

FIG. 1 is a schematic flowchart illustrating a method for classificationof log events and alerting a user about an urgent event, for example animportant and/or dangerous event, according to some embodiments of thepresent invention;

FIG. 2 is a schematic flowchart illustrating a method for classificationof log events and based on user behavior and/or queries, according tosome embodiments of the present invention; and

FIG. 3 is a schematic illustration of an exemplary system forclassification of log events, according to some embodiments of thepresent invention.

DESCRIPTION OF SPECIFIC EMBODIMENTS OF THE INVENTION

Some embodiments of the present invention provide a system forclassification and presentation of system situations, such as statesand/or events. In addition to system situation classification, possibleremediation solutions gathered from various sources may be coupled tocorresponding system situations, and may be presented to the usertogether with information about the issue or event. Additionally, alertsmay be provided in cases of urgent situations.

Throughout the following description, the terms “situation” and “event”may be used interchangeably, meaning a system issue, event, state orstatus, for example, relating to system performance, availability,reliability, security, scalability, and/or other situation of thesystem. As used herein, a log event means any system and/or user action,situation, occurrence and/or error, such as, for example, log entries ofuser actions and/or system errors, system status messages, mobile devicetelemetry, control signals, absence of an expected event.

A classification system according to some embodiments of the presentinvention may monitor event logs of multiple target systems. An eventlog of a target system may document an updating list of timed situationsof the target system. The classification system may collectsituation-related information from various open web sources or availableclosed sources such as manuals, discussion boards or expert systems. Thecollected data is used for labeling the situations and/or forformulating solution lists such as, for example, data sheets ofinformation and/or solutions related to respective situations. In casethe situation is labeled as important, the classification system mayalert a user about the important situation.

Further, the classification system may receive user queries aboutsituations and provide solution lists related to the query-relatedsituations. The classification system may monitor the user behavior,e.g. additional queries, interaction with the solution list, interactionwith enterprise level data management systems, and/or any other relevantbehavior following the query, and use the monitored behavior forlabeling of events and/or formulating the solution lists.

Throughout the present description, “labeling” means giving labels todata items such as log events, event clusters, lack of events, and/orother system situations. Exemplary labels may include, for example,binary labels such as “interesting”/“not interesting”, “critical”/“noncritical”, “malicious”/“benign”, “urgent”/“not urgent”, and/or othersuitable binary labels, or non-binary labels about the importance of thesituation, for example, the urgency, criticality, danger, and/or otherproperties of the situation. In some embodiments of the presentinvention, labels may also take the form of ordinal data, for example anumerical or enumerated value in some scale. Labeling data, according tosome embodiments of the present invention, may be extracted based onmonitoring an analyzing multiple situations and related behavior and/orinput from various users and/or resources. Thus, alerts and decisionsmay be made by an open-ended engine that may detect issues by continuousself-learning, for example, without the need to provide pre-determinedlists of signatures.

Before explaining at least one embodiment of the invention in detail, itis to be understood that the invention is not necessarily limited in itsapplication to the details of construction and the arrangement of thecomponents and/or methods set forth in the following description and/orillustrated in the drawings and/or the Examples. The invention iscapable of other embodiments or of being practiced or carried out invarious ways.

The present invention may be a system, a method, and/or a computerprogram product. The computer program product may include a computerreadable storage medium (or media) having computer readable programinstructions thereon for causing a processor to carry out aspects of thepresent invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network.

The computer readable program instructions may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider). In some embodiments, electronic circuitry including, forexample, programmable logic circuitry, field-programmable gate arrays(FPGA), or programmable logic arrays (PLA) may execute the computerreadable program instructions by utilizing state information of thecomputer readable program instructions to personalize the electroniccircuitry, in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

Reference is now made to FIG. 1, which is a schematic flowchartillustrating a method 100 for classification of log events and alertinga user about an urgent event, for example an important and/or dangerousevent, according to some embodiments of the present invention.

Method 100 may be executed by a classification system that monitors logevents by a system monitor(s), gathers information by web monitor(s),and classifies the log events according to the gathered information. Asused herein a monitor means a software application that collectsinformation. A web monitor may include an agent such as, for example, aprogrammed web crawler bot that browses in the WWW and catches relevantinformation pages and or fragments. A web monitor may collectinformation about events and/or event types, from various web resourcesand/or other information resources, for example by crawling. Theevent-related information may include, for example, data from publiclyavailable knowledge bases such as, for example, Wild sites, topicspecific communities, Questions and Answers (Q&A) pages, source codesites and/or public expert systems. The collection of the event-relatedinformation may include, for example, reading and analyzingdocumentation of various systems and products, analyzing their textand/or extracting information about an event.

Reference is also made to FIG. 3, which is a schematic illustration ofan exemplary system 300 for classification of log events, according tosome embodiments of the present invention. System 300 monitors a targetunit 60 such as, for example, a network of workstations or any othercomputerized system. Classification system 300 may include a memory 30,a network interface 12 and one or more processor(s) 18 that execute aweb monitor 14, machine learning module 20, and a user service engine40. Web monitor 14 may monitor information network(s) such as, forexample, the World Wide Web (WWW). Additionally, system 300 may includevarious databases such as labeling database 22, features database 24,decision rules database 26 and solution lists database 28, which aredescribed in detail herein.

As indicated in block 110, processor 18 may receive via networkinterface 12 streams of system events occurring in unit 60 and/or storethe system events in an event log 13, for example along with respectivetime stamps. The system events may include, for example, log entries ofuser actions and/or system errors, system status messages, mobile devicetelemetry, control signals, and/or any other suitable system events. Insome embodiments, the system events may include a notice about absenceof an expected event and/or about relation between correlated events.

Further, as indicated in block 120, web monitor 14 may collectevent-related information such as, for example, pattern matching forreserved words, recognizable product names, recognizable severity,combination of words/phrases that have been learned to be ofsignificance, any algorithmic Natural Language Processing (NLP) output,and/or any other suitable event-related information. Web monitor 14 mayinclude a translator to translate the gathered event-related informationto computable machine data, which may be processed by processor 18. Forexample, features database 26 may include a multi-dimensional featurespace. An event-related information entry may be analyzed to extractvarious features from the entry, and may be mapped into the featurespace, for example as a multi-dimensional feature vector. Processor 18may classify the collected information according to related eventsand/or classification tasks. Accordingly, in some embodiments, processor18 may classify events by various classification engines that classifyevents in different classes for different purposes. That is, forexample, an event-related feature may be associated with an event whenrelated to a certain classification purpose and not associated with thesame event when related to another classification purpose.

According to some embodiments of the present invention, event log 13 andthe event-related information are provided to processor 18 in order toclassify the log events and, for example, generate classified collectionof solutions for respective system events.

As indicated in block 130, processor 18 may extract labeling data fromevent log 13 and/or from the event-related information, such as, forexample, data about urgency of events, for example importance and/orseverity of events. As used herein, data about urgency of events mayinclude data about urgency, importance, severity, stability, criticalityand/or measure of attention required by a user. For example, data abouturgency may be deduced based on upcoming failure, attack, threat,anomaly, and/or any other occurrence type that requires attention of auser.

The extracted labeling data may include, for example, previously labeledevents, for example analyzed by users. The extracted labeling data mayinclude, for example, imported and/or processed data from publiclyavailable knowledge bases such as, for example, Wild sites, topicspecific communities, Questions and Answers (Q&A) pages, source codesites, product documentation, system guides, system manuals and/orpublic expert systems. The extracted labeling data may include, forexample, systematically analyzed system events, previous user queries,user feedback and/or behavior implied, for example, by temporal profilesand/or interaction with the system.

Additionally, processor 18 may extract event features data from eventlog 13 and/or from the collected event-related information. The featuresdata related to an event may include event identification and solutioninformation such as, for example, a timestamp, length, richness of text,keywords, product packages, debug level, votes, code fragments, remarksand comments, expert system analysis, event processes, eventcorrelation, lack of expected events, and/or any other suitableinformation, for example, translated to a quantifiable measure, ifneeded.

For example, event features data may be projected on a multi-dimensionalfeature space. Labeling data may be projected to a separatemulti-dimensional feature space. The feature and/or labeling spaces maybe generated by textual and/or behavioral analysis. For example, textfragments are matched to known textual items. For example, numericalfeatures such as length, frequency and/or other measure values areextracted from the text. Behavioral features may include implicit and/orexplicit user interest in a log event, user offering of a clear andsimple labeling approach, and/or any other suitable behavioral features.

For example, for a log saying “2016-06-06 ERROR_LOG Apache_Tomcat Failedto serve client with data, Aborting”, the extracted features may be, forexample, the timestamp, which may be used for monitoring frequency of anevent, ERROR as a severity measure, Tomcat as the product name, and anyother suitable extracted features. These features are then placed in anordered feature vector. This vector may be of very high dimensionality,due to the high number of products, severity levels and other features.Additionally, for example, the severity feature ERROR, the eventfrequency, the product type and/or the length may be used as labelingdata.

In some embodiments of the present invention, system 300 may furtherinclude a user feedback interface 16, by which system 300 may receiveuser feedback about events, for example about severity/urgency and/orother features of the event. Processor 18 may extract from the receiveduser feedback, for example, labeling data and/or event features data.

Additionally, by user interface 16, processor 18 may directly receivefrom a user information about events, solutions suggested by the userand/or labeling of events suggested by a user, which may be used byprocessor 18 as labeling and event features data.

The extracted labeling data and event features may be stored in labelingdatabase 22 and features database 24, respectively, in association withthe respective events.

As indicated in block 140, based on the extracted labeling data,processor 18 may generate labeling data structures that ascribe labelsto respective events in the form of, for example, data tables,vectors/matrices, clusters, and or any other suitable data structure.For example, processor 18 may deduce data about urgency, importanceand/or danger of events from the labeling data extracted from event log13 and/or from the event-related information. The labeling data mayinclude and/or be ordered in a labeling space of multiple dimensions,such as, for example, dimensions of various types of key words,dimensions of various behavior types, and/or any other suitable labelingdata dimensions. For example, a log event may include data regardingimportance, user specific or user group importance, urgency and/orrelevancy of the log. For example, processor 18 may identify keywordssuch as, for example, debug, info, error, fatal, exception, and/or anyother suitable key words that may be indicative of urgency, importanceand/or danger of an event. Such keyword lists and/or interpretation maybe generated automatically, for example, by the machine learning processdescribed herein. For example, user behaviors, for example user events,that are inspected frequently, may be indicative that these events arecandidates to receive a high urgency label. In some embodiments of thepresent invention, specific events and/or types of events are assignedto trigger an alerting system. Then, processor 18 may translate labelingdata, for example data about urgency, importance and/or danger ofevents, to labels ascribed to respective events.

In some embodiments of the present invention, the labels may providebinary classification such as, for example, important/not important,urgent/not urgent, dangerous/not dangerous, and/or any other suitableform of binary classification. In other embodiments, the labels mayprovide more levels of classification, for example, various levels ofimportance, urgency, danger, and/or any other suitable labelingparameter.

For example, processor 18 may generate the labeling data structures inthe form of data vectors, in which labeling data is stored inassociation with respective events and, optionally, in association withclassification tasks. In some other embodiments, processor 18 maycluster the events according to suitable and/or predeterminedparameter(s) and generate the feature data in the form of clusters ofevents, wherein each cluster has a corresponding label. Some of theevents may belong to more than one cluster. Some of the clusters may beassociated with respective classification tasks. In some embodiments,processor 18 may classify the events by k-nearest neighborclassification, according to locations of extracted data items in thedata structures, thus finding common patterns and and/or similaritybetween log events.

Further, based on the event features data, processor 18 may generateevent features data structures that ascribe features to respectiveevents, in the form of, for example, data tables, vectors/matrices,clusters, and or any other suitable data structure.

Processor 18 may execute a machine learning mechanism 20, which mayformulate, based on the labeling data structures and the event featuresdata structures, decision rule structures for identifying urgent eventsand/or deciding how to formulate a solution list for a given event, asindicated in block 150. The decision rule structures may constitute, forexample, classifier engines that may be used by processor 18 foridentifying and deciding.

For example, a decision rule may include thresholds in one or moredimensions of labeling data and/or of event features data. For example,processor 18 may allocate scores to data items. For example, score maybe allocated to event titles, for example, so that ERROR has higherscore than NOTICE and lower score than WARNING. In some embodiments, alog event is identified as important, for example, when an event titlehas at least the score of ERROR title. In some embodiments, in caseseveral words included in an event log has allocated scores, acumulative score may be computed for the event, and an event with highercumulative score may be regarded as a more important event. For example,a decision rule may include sending an alert when a cumulative score isabove a pre-defined threshold.

For example, processor 18 may allocate scores to event features that aremore popular and/or mentioned more frequently. Processor 18 may includein a generated solution list an event feature such as, for example, asolution and/or explanation of a certain system situation, when thefeature has a score above a certain threshold.

In order to formulate the decision rules, processor 18 may, for example,detect patterns in the labeling data and/or event features, which mayimply on the urgency and/or other features of events. Machine learningmechanism 20 may include, for example, Neural Networks, Support VectorMachines, Deep Learning, Decision Trees, Hard/Soft Thresholds, NaiveBayes Classifiers and/or any other suitable learning systems and/ortools. Machine learning mechanism 20 may generate decision rulestructures, for example in the form of vectors/matrices of features,set(s) of rules, decision trees and/or any other suitable form. Forexample, each node or position in the decision rule structures may beattributed to a specific feature and/or feature vector. The decisionrule structures may be sorted, for example, according to values ofcertain feature(s), and/or may be grouped according to mutual featuresvalues and/or patterns.

As indicated in block 160, processor 18 may identify an urgent eventbased on the decision rule structures. Once an urgent event isidentified, as indicated in block 170, processor 18 may formulate,according to the decision rules, a solution list, e.g. classifiedcollection of features and/or solutions for the identified urgent event,and may send an alert to the user about urgent event, along with thesolution list.

The formulated decision rules may be stored in decision rules database26 and may be updated by processor 18, for example whenever a decisionrule is changed by machine learning mechanism 20. The solution lists maybe generated or re-generated by processor 18, for example upon a changein a relevant decision rule identification of an urgent event and/orreceiving of a user's query about an event, and may be stored insolution lists database 28.

Reference is now made to FIG. 2, which is a schematic flowchartillustrating a method 200 for classification of log events and based onuser behavior and/or queries, according to some embodiments of thepresent invention. As indicated in blocks 210 and 220, processor 18 mayreceive streams of system events and collect event-related information,as described in detail with reference to FIG. 1.

As shown in FIG. 3, user service engine 40 may include a user behaviormonitor 44, which may be, for example, a software component to monitorand analyze user behavior. As indicated in block 230, user serviceengine 40 may receive via interface 16 user queries about system eventsfrom a user machine 50. In some embodiments of the present invention,processor 18 extracts labeling data and event features data from theuser queries. For example, as indicated in block 240, user serviceengine 40 may monitor by behavior monitor 44 user behavior, for exampleinteraction with solution lists results and/or with service engine 40such as, for example, opening of links, queries, reviewing queriesresults, consequent queries, last query performed, editing of alerts,import and export of data from enterprise data management systems,deleting of solution list results, and/or any other suitable form ofinteraction. Behavior monitor 44 may send user behavior monitoring datato processor 18. Processor 18 may analyze the user behavior and extractlabeling data and/or event features data from the user behavior, forexample along with the of system events and collected event-relatedinformation, as indicated in block 250.

As indicated in blocks 260 and 270, based on the extracted labeling dataand/or event features data, processor 18 may generate labeling datastructures that ascribe labels to respective events and event featuresdata structures that ascribe features to respective events, as describedin detail with reference to FIG. 1. Further, processor 18 may formulatedecision rule structures, as described in detail with reference toFIG. 1. Accordingly, in some embodiments of the present invention,processor 18 may analyze the user behavior and base the formulation ofthe decision rule structures on the user behavior.

Upon receiving a user query, as indicated in block 280, user serviceengine 40 may find in decision rule structures database 26 decisionrules related to the query. For example, queries are mapped into thelabeling and/or event features data structures, for example into themultidimensional labeling and/or event features spaces, and accordinglya suitable decision rule may be applied. In some embodiments of thepresent invention, the user's behavior in relation to the query may beused to obtain the labeling data, as described in detail herein, inorder to provide relevant decision rules. For example, processor 18 mayidentify in the rule structures events related to the query, for examplebased on the projection of the query on the labeling/feature spaces andidentifying of related events. Then, processor 18 may relate to thequery the decision rule structures associated with query-related events.

Then, as indicated in block 290, user service engine 40 may obtain asolution list from database 28 that relate to the query, for examplesolution lists associated with events identified by processor 18 asrelated to the query. User service engine 40 may provide the obtainedsolution list to the user in response to the user query. In someembodiments of the present invention, processor 18 may formulaterelevant solution lists upon receiving a query from a user, for examplebased on related decision rules received from database 26.

In some embodiments of the present invention, processor 18 may use userfeedback received via user feedback interface 16 to create personal userprofiles. Processor 18 may correlate received feedback to respectiveusers, for example, by generating a feedback-user correlation matrixand/or store the feedback-user correlation matrix in memory 30. Then,processor 18 may determine the personal labeling requirements of a userbased on the user's feedback, which may vary according to the user's useof the system. For example, a certain user may require labeling aboutaspects of database relations, while another user may require labelingabout aspects of security. For example, machine learning mechanism 20may learn the personal labeling requirements by non-supervised learningmethods including, for example, k-means clustering, Linear DiscriminantAnalysis (LDA) and/or any other suitable classification algorithm.

According to the personal labeling requirements, processor 18 may createpersonal user profiles, each including the personal labelingrequirements of the respective user, and/or store the personal userprofiles in memory 30. The number of profiles stored in memory 30 mayvary dynamically. Processor 18 may use the personal user profiles tocalculate labels based on behavioral data in view of the user's profileand thus, for example, to enhance and reinforce implicit user labelingand to augment data scoring. For example, based on the user profile, theextraction of labeling data may be enhanced by matching the labeling tothe user's requirements. For example, based on the user profile, apersonal event scoring per user may be generated.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the embodiments, the practical application or technicalimprovement over technologies found in the marketplace, or to enableothers of ordinary skill in the art to understand the embodimentsdisclosed herein.

As used herein the term “about” refers to ±10%.

The terms “comprises”, “comprising”, “includes”, “including”, “having”and their conjugates mean “including but not limited to”. This termencompasses the terms “consisting of” and “consisting essentially of”.

The phrase “consisting essentially of” means that the composition ormethod may include additional ingredients and/or steps, but only if theadditional ingredients and/or steps do not materially alter the basicand novel characteristics of the claimed composition or method.

As used herein, the singular form “a”, “an” and “the” include pluralreferences unless the context clearly dictates otherwise. For example,the term “a compound” or “at least one compound” may include a pluralityof compounds, including mixtures thereof.

The word “exemplary” is used herein to mean “serving as an example,instance or illustration”. Any embodiment described as “exemplary” isnot necessarily to be construed as preferred or advantageous over otherembodiments and/or to exclude the incorporation of features from otherembodiments.

The word “optionally” is used herein to mean “is provided in someembodiments and not provided in other embodiments”. Any particularembodiment of the invention may include a plurality of “optional”features unless such features conflict.

Throughout this application, various embodiments of this invention maybe presented in a range format. It should be understood that thedescription in range format is merely for convenience and brevity andshould not be construed as an inflexible limitation on the scope of theinvention. Accordingly, the description of a range should be consideredto have specifically disclosed all the possible subranges as well asindividual numerical values within that range. For example, descriptionof a range such as from 1 to 6 should be considered to have specificallydisclosed subranges such as from 1 to 3, from 1 to 4, from 1 to 5, from2 to 4, from 2 to 6, from 3 to 6 etc., as well as individual numberswithin that range, for example, 1, 2, 3, 4, 5, and 6. This appliesregardless of the breadth of the range.

Whenever a numerical range is indicated herein, it is meant to includeany cited numeral (fractional or integral) within the indicated range.The phrases “ranging/ranges between” a first indicate number and asecond indicate number and “ranging/ranges from” a first indicate number“to” a second indicate number are used herein interchangeably and aremeant to include the first and second indicated numbers and all thefractional and integral numerals therebetween.

It is appreciated that certain features of the invention, which are, forclarity, described in the context of separate embodiments, may also beprovided in combination in a single embodiment. Conversely, variousfeatures of the invention, which are, for brevity, described in thecontext of a single embodiment, may also be provided separately or inany suitable subcombination or as suitable in any other describedembodiment of the invention. Certain features described in the contextof various embodiments are not to be considered essential features ofthose embodiments, unless the embodiment is inoperative without thoseelements.

All publications, patents and patent applications mentioned in thisspecification are herein incorporated in their entirety by referenceinto the specification, to the same extent as if each individualpublication, patent or patent application was specifically andindividually indicated to be incorporated herein by reference. Inaddition, citation or identification of any reference in thisapplication shall not be construed as an admission that such referenceis available as prior art to the present invention. To the extent thatsection headings are used, they should not be construed as necessarilylimiting.

1. A system for classification of events, the system comprising: amemory; a network interface; and a processor configured to execute acode for: monitoring a plurality of system events, using a web monitor,via the network interface and storing the plurality of system events asan event log in the memory; collecting information about events from aplurality of available knowledge bases; extracting, from the event log,labeling data comprising data, that according to an analysis of saidinformation collected from said plurality of available knowledge bases,is identified as indicative of urgency of each of said plurality ofsystem events and generating, based on the extracted labeling data,labeling data structures ascribing labels to each of said plurality ofsystem events; extracting, from the event log and according to saidanalysis of the collected event information, event features data andgenerating, based on the extracted event features data, event featuresdata structures ascribing features to each of said plurality of systemevents; formulating decision rule structures for identification of anurgency level of an event based on the labeling data structures and theevent features data structures; and determining for each of saidplurality of system events a respective urgency level.
 2. The system ofclaim 1, wherein data about urgency of events comprises at least one ofdata about stability, data about criticality, data about failureimminent, data about a denial-of-service attack, data about threatsdetected, data about anomalies detected, data about business impact, anddata about relevance.
 3. The system of claim 1, wherein the collectedevent information comprises labeling data and event features receiveddirectly from a user via a feedback interface.
 4. The system of claim 1,wherein the processor is configured to execute code for using asignature-less self learning system for formulating the decision rulestructures.
 5. The system of claim 1, wherein the processor isconfigured to execute code for classification of log events according tolocations of log events in the data structures.
 6. The system of claim1, wherein the processor is configured to execute code for combining thecollected event information with data received directly from a user toformulate the decision rule structures.
 7. The system of claim 1,wherein the processor is further configured to formulate a solution listabout a given event, including information about the event, according tothe decision rules.
 8. The system of claim 1, further comprising a userinterface configured to receive user feedback about events, wherein saidprocessor is further configured to extract labeling data and/or eventfeatures data from the user feedback.
 9. The system of claim 8, whereinthe processor is configured to execute code for building a user profilebased on queries and/or labels received via the user interface.
 10. Thesystem of claim 9, wherein the processor is configured to execute codefor utilizing the user profile to enhance the labeling data extraction.11. The system of claim 9, wherein the processor is configured toexecute code for utilizing the user profile to generate a personal eventscoring per user.
 12. The system of claim 1, wherein said processor isfurther configured to detect patterns in the labeling and/or eventfeatures data structures and to formulate the decision rules based onthe detected patterns.
 13. The system of claim 1, further comprising aquery interface to receive user queries about events, wherein saidprocessor is further configured to extract labeling data and/or eventfeatures data from the user queries.
 14. The system of claim 13, whereinthe processor is further configured to monitor user behavior at thequery interface and to extract labeling data and/or event features datafrom the user queries.
 15. The system of claim 7, further comprising asolution database configured to store the formulated solution lists inassociation with the respective events, wherein the processor is furtherconfigured to receive user queries about system events and to providethe associated solution lists in response to the user queries.
 16. Thesystem of claim 14, wherein the processor is further configured tomonitor the user behavior with a user service engine, to analyze theuser behavior and to further formulate the decision rule structuresbased on the user behavior.
 17. The system of claim 1, wherein theprocessor is further configured to: map a user query into the labelingdata structures and event features data structures; identify based onthe mapping query-related log events; and relate to the user query atleast one associated decision rule.
 18. The system of claim 1, whereinthe processor is further configured to execute a translator to translatethe events information to computable machine data.
 19. The system ofclaim 1, wherein the processor is configured to generate the labelingdata structures in the form of data vectors, in which labeling data isstored in association with respective events.
 20. The system of claim19, wherein the labeling data is stored in association with respectiveevents and classification tasks.
 21. The system of claim 1, wherein theprocessor is configured to generate the labeling data structures in theform of clusters of events, wherein each cluster has a correspondinglabel.
 22. The system of claim 21, wherein at least one of the eventsbelongs to more than one cluster.
 23. The system of claim 21, wherein atleast one of the clusters is associated with a classification task. 24.The system of claim 1, wherein the processor is configured to store thesystem events in the event log along with a respective time stamp. 25.The system of claim 1, wherein the processor is further configured toclassify the collected information according to respective events and/orclassification tasks.
 26. The system of claim 1, wherein the processoris configured to extract the labeling data based on multiple monitoredevents.
 27. A method for classification of events, the methodcomprising: monitoring, by a processor using a web monitor, a pluralityof system events via the network interface and storing the plurality ofsystem events as an event log in the memory; collecting, by theprocessor, event-related information about events from a plurality ofavailable knowledge bases; extracting, by the processor, labeling data,comprising data, that according to an analysis of said informationcollected from said plurality of available knowledge bases, isidentified as indicative of urgency of each of said plurality of systemevents, and event features data, from the event log and from theevent-related information; generating, based on the extracted labelingdata, labeling data structures ascribing labels to each of saidplurality of system events, and based on the extracted event featuresdata, event features data structures ascribing features to each of saidplurality of system events; formulating decision rule structures foridentification of an urgency level of an event based on the labelingdata structures and the event features data structures; and determiningfor each of said plurality of system events a respective urgency level.28. A method for classification of events, the method comprising:receiving, by a processor, from a user interface, a user query about asystem event using a query interface of said user interface; monitoring,by a processor, user behavior associated with a plurality of previousqueries, in relation to the user interface; formulating decision rulestructures for formulation of solution lists about events based on theuser behavior; and instructing formulation and transmission to the usera solution list relevant to the user query, based on the decision rules.29. The system of claim 1, wherein said analysis of said informationcollected from said plurality of available knowledge bases is conductedusing Natural Language Processing (NLP) algorithm.